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SPECIFICATION 

Electronic Version 1 .2.8 
Stylesheet Version 1 .0 

METHOD AND SYSTEM FOR 
LABELING OF ORTHOGONAL 

IMAGES 

Background of the Invention 

[0001] This invention relates to image labeling. More particularly, the invention relates to 
the labeling of orthogonal images. 

[0002] An imaging system uses, among others, electromagnetic radiation, x-rays, sonic 
waves, or photonic energy to produce images of a target body, such as a human 
patient. The images produced by the imaging system provide views of the target body 
at various planes extending through the target body. For many applications, a primary 
image is taken along one plane, and corresponding secondary images are taken at 
multiple planes extending orthogonal to the primary image. 

[0003] -j_^ e j ma gj n g S y S tem also includes a computer or network of computers to store, 
manage, display, and retrieve the images. The computers may be part of an image 
management system, such as a picture archiving and communications system (PACS). 
To aid in the application of the images for diagnosis, analysis, and the like, the 
imaging system may allow the images to be labeled (annotated) by a technician, 
physician, or other user. Labeling is typically accomplished using an input device to 
indicate a point on a displayed image and to input or select the appropriate label 
(notation) to be displayed at the indicated point. The label appears on the displayed 
image, and is associated with the image in computer memory such that when the 
image is retrieved at a later time, the label appears on the displayed image. Where the 
label is made on the primary image, it is often required that a label appear on the 
secondary image associated with the point on the primary image selected by the 
pointing device. This allows the label to act as a point of reference between the two 
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images. 

[0004] One example of such annotation is known as "spine labeling", which is the act of 
placing a text annotation near a vertebra of an imaged human spine. In the imaging of 
the human spine, a primary image may be taken in the sagittal plane (looking from 
the left or right side of the body), and one or more series of secondary images may be 
taken in the axial plane (looking from above the head or below the feet). Each series 
of secondary images contains a plurality of secondary images. Spine labeling includes 
placing a label near a vertebra of an imaged spine to serve as a point of reference for 
anyone viewing the image. The same label is also placed on the secondary image 
including the vertebra in each series of secondary images. Typically, such labels are 
used before neurosurgery or orthopedic surgery, for radiation therapy planning, and 
for interventional radiological procedures. 

[0005] The annotation of orthogonal images can be time consuming. The person 

performing the annotation must label the primary image as well as the appropriate 
secondary image in each series. Care must be taken to ensure that the labels are 
placed consistently in each of the images. 

Brief Summary of the Invention 

[0006] The above-described drawbacks and deficiencies are overcome or alleviated by a 
method of labeling orthogonal images, the method comprising: identifying a primary 
image taken in a first plane; identifying a plurality of secondary images taken in 
planes orthogonal to the first plane; associating a label to a point in the primary 
image; calculating a distance from the point to a line of intersection between the 
primary image and each secondary image in the plurality of images; and associating 
the label to a secondary image in the plurality of secondary images having a line of 
intersection with the primary image closest to the point. 

[0007] 

In another aspect, a system for acquiring images of a target body comprises an 
imaging device and a computer. The imaging device is configured to provide a 
primary image and a plurality of secondary images of the target body, the primary 
image being taken at a first plane through the target body and the secondary images 
being taken at second planes through the target body. The computer is configured to 
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receive the primary and secondary images from the imaging device. The computer is 
further configured to associate a first label to a point in the primary image, calculate a 
distance from the point to a line of intersection between the primary image and each 
secondary image in the plurality of images, and associate a second label to a 
secondary image in the plurality of secondary images having a line of intersection with 
the primary image closest to the point. 

[0008] The above discussed and other features and advantages of the present invention 
will be appreciated and understood by those skilled in the art from the following 
detailed description and drawings. 

Brief Description of the Drawings 

[0009] Referring to the exemplary drawings wherein like elements are numbered alike in 
the several Figures: 

[001 0] Fig. 1 is a block diagram of an imaging system that employs an embodiment of 
the present invention; 

[001 1 ] Fig. 2 is a schematic diagram of a plurality of images displayed relative to a target 
body; 

[001 2] Fig. 3 is a schematic representation of an image of the target body taken in one 
plane; 

[0013] Fig. 4 is a schematic representation of orthogonal images of the target body; 

[0014] Fig. 5 is a schematic representation of an image of the target body taken in a 
plane orthogonal to the image of Fig. 3; and 

[001 5] Fig. 6 is flow chart depicting a method of labeling orthogonal images. 

Detailed Description of the Invention 

[0016] 

Referring to Fig. 1 , an imaging system 1 0 is shown. Imaging system 1 0 includes 
one or more imaging devices 12 coupled to one or more computers 14. Imaging 
devices 12 include, but are not limited to, magnetic resonance (MR) imaging devices, 
computed tomography (CT) devices, ultrasound devices, x-ray devices, positron 
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emission tomography (PET) devices and a variety of other types of imaging devices. It 
should be understood that imaging devices 12 are not limited to medical imaging 
devices and can also include scanners and imaging devices from other fields. Imaging 
devices 12 may be located throughout a facility, such as a hospital. 

[001 7] Each of the computers 1 4 includes a storage unit 1 6, a processor 1 8, a display 20, 
and an input device 22. Input device 22 can include, but is not limited to, a mouse, a 
joystick, a keyboard, a trackball, a touch screen, a light wand, and a voice control. The 
one or more computers 14 may be coupled to the imaging devices 12 via wiring, 
printed circuit board, or other direct connection means. Alternatively, the one or more 
computers 14 may be coupled to the imaging devices 1 2 via a communications 
network (e.g., an ether net, internet, fiber optic, infrared, radio frequency, or other 
applicable communications network), allowing the computers 14 to be located 
remotely from the imaging devices 12 and from each other. 

[0018] The one or more computers 14 may be part of an image management system, 

such as a picture archiving and communications system (PACS). In this embodiment, 
one of the computers 14 may serve the function of an image manager or system 
server, including an archival storage unit (e.g., an optical disc storage and optical disc 
reader system) for long-term storage and retrieval (not shown). The other computers 
14 may serve as workstations. 

[0019] During an examination of a target body, such as a portion of a patient's anatomy, 
one or more imaging devices 1 2 are used to acquire images of the target body. Each 
acquired image is in a digitized data format, such as DICOM, DEFF, TIFF, GIF, JPEG, 
TGA, BMP, PCX, XWD, PBM, PGM, PPM, SGI RGB, Sun Raster, PostScript Levels I and II, 
or other suitable format, and is communicated from imaging devices 1 2 to one or 
more of the computers 14. At least one computer 14 stores the acquired images, with 
appropriate identifiers and links such that the images or series of images can be 
selectively retrieved from computer memory. 

[0020] Referring to FIGs. 1 and 2, one or more imaging devices 1 2 acquires a primary 
image 50 taken along one plane (e.g., the x-y plane of FIG. 2) extending through a 
target body 52. The one or more imaging devices 12 also acquires one or more series 
56 of secondary images 54 taken at multiple planes orthogonal to the primary image 
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50 plane (e.g., the x-z plane of FIG. 2). Each series 56 of secondary images 54 
contains a plurality of secondary images 54. The imaging performed by imaging 
devices 1 2 may include, for example, the imaging of a human spine, where primary 
image 52 is taken in the sagittal plane (looking from the left or right side of the body), 
and one or more series 56 of secondary images 54 are taken in the axial plane 
(looking from above the head or below the feet). It will be appreciated, however, that 
the terms "primary" and "secondary" are used herein only for clarity and do not 
indicate specific views, planes, or the sequence in which the images 52 or 54 are 
acquired. 

[0021] To aid in the application of the images 52 and 54 for diagnosis, analysis, and the 
like, the computers 14 allow the images 52 and 54 to be annotated (labeled) by a 
technician, physician, or other user. Annotation is accomplished using input device 22 
to indicate a point 58, as shown in Fig. 3, on primary image 50 and to input or select 
the appropriate label (notation) 60 to be displayed at the indicated point 58. The label 
60 appears on the displayed primary image 50, and is associated with the primary 
image 50 in computer 14 such that when the primary image 50 is retrieved at a later 
time, the label 60 appears on the displayed primary image 50. The association 
between the label 60 and the primary image in computer 14 may be performed using 
any suitable means such as, for example, database linking, pointers, data structures, 
objects, and direct alteration of the primary image 50. 

[0022] 

The storage unit 16 in one or more of the computers 14 includes instructions for 
causing the computer 14 to implement a method for labeling the secondary images 
54. The decision of which secondary image 54 will get the label 60 is based on the 
spatial relationships between the primary image 50 and each of the secondary images 
54. Since the primary 50 image and secondary images 54 are in orthogonal 
(perpendicular) planes, the secondary images 54 intersect the primary image 50 plane 
at a line of intersection 62, as shown in Fig. 4. The distance from each point 58 in the 
primary image 50 to the location of each line of intersection 62 in the primary image 
plane may be calculated using the equation: 
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[0023] 



[0024] 



[0025] 



[0026] 



where axo+byo+c is the line of intersection 62, and 
(xo, >'o) is the point 58 in the primary image 50. 

Thus, the label 60 on the secondary image 54, shown in Fig. 5, is a reflection of 
the label 60 in the primary image 50, shown in Fig. 3. 

The label 60 applied to the secondary image 54 is associated with the secondary 
image 54 in computer 14 such that when the secondary image 54 is retrieved at a 
later time, the label 60 appears on the displayed secondary image 54. The association 
between the label 60 and the secondary image 54 in computer 14 may be performed 
using any suitable means such as, for example, database linking, pointers, data 
structures, objects, and direct alteration of the secondary image 54. 

The label 60 applied to the secondary image 54 may be the same instance of the 
label 60 applied to the primary image 50 (e.g., the same instance of a label object, 
database element, data structure, or the like). In this embodiment, any changes to the 
label 60 made in one image 50 or 54 will be affected in the other image 50 or 54. 
Such changes may include, for example deletion of the label 60, changing of the label 
60 text, or movement of the point 58 to which the label 60 is applied. Alternatively, 
the label 60 applied to the secondary image 54 may be different than the label 60 
applied to the primary image 50. In this embodiment, the instances of each label 60 
are associated in computer 14 such that changes in the label 60 made in one image 
50 or 54 will be affected in the other image 50 or 54. The association between the 
labels 60 in each of the images 50 and 54 may be performed using any suitable 
means such as, for example, database linking, pointers, data structures, and objects. 

Fig. 6 is a flow chart depicting an embodiment of the method for labeling 
secondary images 54. Upon starting, method 100 begins at block 102, where the 
point 58 on primary image 50 and the desired label 60 are input from input device 22. 
Method 100 continues at block 104 where the label 60 is associated with the point 5 8 
on the primary image 50 in computer 14. The label 60 may also be displayed along 
with primary image 50 on display 20. At block 106, a distance between the point 58 
on the primary image 50 and the line of intersection 62 between the primary image 50 
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and the first secondary image 54 in the first series 56 of images is calculated. This 
calculation may be performed using equation (1), above. Method 100 then continues 
to block 1 08 where it is determined whether the secondary image 54 is the last image 
in the series 56. If not, the next secondary image 54 in the series 56 is selected in 
block 1 10, and method 100 repeats the calculation at block 106 for this next image. 
If, in block 1 08, it is determined that the secondary image 54 is the last image in the 
series 56, method 1 00 continues to block 1 1 2, where the secondary image 54 having 
the closest line of intersection 62 to the point 58 on the primary image 50 is 
determined, and a label 60 is associated with this secondary image 54. As previously 
noted, this label 60 may be the same label as applied to the primary image 50 in block 
1 04, or may be a different label. Method 1 00 then continues to block 1 1 4, where it is 
determined whether the series 56 is the last series to be labeled. If not, the next 
series 56 is selected at block 1 16, and method 100 continues at blocks 106 through 
1 12 to label this next series 56. If, in block 1 14, the last series 56 of images has been 
labeled, method 100 ends. 

[0027] The method and system described herein saves time and effort in labeling 

orthogonal images. The person performing the labeling need only label the primary 
image, and the appropriate secondary image in each series are automatically labeled. 
The method and system described herein also ensures that the labels are placed 
consistently in each of the images. 

[0028] jft e present invention can be embodied in the form of computer-implemented 

processes and apparatuses for practicing those processes. The present invention can 
also be embodied in the form of computer program code containing instructions 
embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any 
other computer-readable storage medium, wherein, when the computer program code 
is loaded into and executed by a computer, the computer becomes an apparatus for 
practicing the invention. The present invention can also be embodied in the form of 
computer program code, for example, whether stored in a storage medium, loaded 
into and/or executed by a computer, or transmitted over some transmission medium, 
such as over electrical wiring or cabling, through fiber optics, or via electromagnetic 
radiation, wherein, when the computer program code is loaded into and executed by a 
computer, the computer becomes an apparatus for practicing the invention. When 
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implemented on a general-purpose microprocessor, the computer program code 
segments configure the microprocessor to create specific logic circuits. 

[0029] While the invention has been described with reference to a preferred embodiment, 
it will be understood by those skilled in the art that various changes may be made and 
equivalents may be substituted for elements thereof without departing from the scope 
of the invention. In addition, many modifications may be made to adapt a particular 
situation or material to the teachings of the invention without departing from the 
essential scope thereof. Therefore, it is intended that the invention not be limited to 
the particular embodiment disclosed as the best mode contemplated for carrying out 
this invention, but that the invention will include all embodiments falling within the 
scope of the appended claims. Moreover, the use of the terms first, second, primary, 
secondary, etc. do not denote any order or importance, but rather the terms first, 
second, primary, secondary etc. are used to distinguish one element from another. 

[0030] What is claimed is: 
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